REDUCED GUTZWILLER FORMULA WITH SYMMETRY: 
CASE OF A FINITE GROUP 



ROCH CASSANAS 

Abstract. We consider a classical Hamiltonian H on R'^'', invariant by a finite group of 
symmetry G, whose Weyl quantization H is a selfadjoint operator on L^(R''). If x 
irreducible character of G, we investigate the spectrum of its restriction to the symmetry 
subspace (jgd) of L'^{K^) coming from the decomposition of Peter- Weyl. We give reduced 
semi-classical asymptotics of a regularised spectral density describing the spectrum of near 
a non critical energy i? S K. If := {H = E} is compact, assuming that periodic orbits 
are non-degenerate in S^/G, we get a reduced Gutzwiller trace formula which makes periodic 
orbits of the reduced space E^/G appear. The method is based upon the use of coherent 
states, whose propagation was given in the work of M. Combescure and D. Robert. 



1. Introduction 

The purpose of this work is to give a Gutzwiller trace formula for a reduced quantum Hamil- 
tonian in the framework of symmetries given by a finite group G of linear applications of the 
configuration space R''. This semi-classical trace formula will link the reduced spectral density to 
periodic orbits of the dynamical system in the classical reduced space, i.e. the space of G-orbits.^ 

The role that symmetry plays in quantum dynamics was obvious since the beginning of the 
theory, and emphasized by Hermann Weyl in the book: 'The theory of groups and quantum 
mechanics' Pioneering physical results were given for models having a lot of symmetries. 

In the mathematical domain, first systematical investigations were done in 1978-79, mainly for 
the eigenvalues counting function of the Laplacian on a Riemannian compact manifold simul- 
taneously by Donnelly and Briining & Heintze (see [2] and Later, Guillemin and Uribe 
described the relation with closed trajectories in "IT and IT. In W^^ a general study was done 
in the early 80's for globally elliptic pseudo-differential operators, both in cases of compact finite 
and Lie groups, by Helffer and Robert (see jTH], 53) fo'" high energy asymptotics, and later 
by El Houakmi and Helffer in the semi-classical setting (see TO", TT]). Main results were then 
given in terms of reduced asymptotics of Weyl type for a counting function of eigenvalues of the 
operator. Here, in a semi-classical study with a finite group of symmetry, we want to go one 
step beyond Weyl formulae, investigating oscillations of the spectral density, and establishing a 
Gutzwiller formula for the reduced quantum Hamiltonian. The case of a compact Lie group will 
be carried out in another paper (see ^ and 

Without symmetry, in 1971, M.C. Gutzwiller published for the first time his trace formula 
linking scmi-classically the spectrum of a quantum Hamiltonian H near an energy E, to periodic 
orbits of the classical Hamiltonian system of H on M^'', lying in the energy shell Yje '■= {H = E}. 
This was one of the strongest illustrations of the so-called 'correspondence principle'. Later, 
rigorous mathematical proofs were given (see for example [2], [221 j EH]) 0)) using various 
techniques like wave equation, heat equation, microlocal analysis, and more recently wave packets 
(see IZl). 

Coming back to classical dynamics, let H : M.'^'^ ^ M be a smooth Hamiltonian with a finite 
group of symmetry G, such that H is G-invariant, i.e. suppose that there is an action AI from 
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G into Sp{d, M), the group of symplectic matrices of R^"*, such that: 

(1.1) H{M{g)z) ^ H{z), Vg G G, Vz G R^' 
The Hamihonian system associated to H is: 

(1.2) zt = JVH{zt), where J = 

In the framework of symmetry, speciaUsts in classical dynamics are used to investigate this 
system in the space of G-orbits : M^'^/G, also called the reduced space. 

Here, for a quantum study with symmetry, it is therefore natural to expect a reduced 
Gutzwiller formula, linking semi-classically the spectrum of the reduced quantum Hamilton- 
ian near the energy E to periodic orbits of the reduced classical dynamical system on Tie/G. 

We now briefly describe our main result. First, we introduce our quantum reduction. We 
follow the same setting as in articles of Helffer and Robert ^Jj: let H : R^"* ^ E be a 
smooth Hamihonian and G a finite subgroup of the linear group GZ(ci, R). If 5 G G, we set: 

(1.3) M(g)(x,C) := (gx,*g"iO 

and we assume that H is G- invariant as in Hl.l|l . As usual, we make suitable assumptions -see 
l|8.5|l - to have nice properties for the Wcyl quantization of H (as functional calculus), which is 
defined as follows : for u G §(R''), 

(1.4) OprAH)u{x) = i27:h)-^ f f ei^^-y^^H u{y)dyd^. 

In particular, Op^{H) is essentially selfadjoint on S(R'*) and we denote by D{H), H its selfadjoint 
extension. 

G acts on the quantum space L^(M'*) by M defined for g G G by : 

(1.5) M{g)(f){x)^ f{g-^x), e L^iR"), Vx G R'*. 

If X is an irreducible character of G, we set d^ :— xild). Then, we define the symmetry subspace 
L^(M'') associated to x, by the image of L^(R'^) by the projector: 

(1-6) P^:=^^^M(g), 

' ' see 

L^(R'') splits into a Hilbcrtian sum of L^(R'*)'s (Peter- Weyl decomposition), and the property 
(|1.1|) implies that each L^(R'*) is stable by H. Our goal is to give semi-classical trace formulae 
for the restriction _ff^ of H to L^(R''), which will be called the reduced quantum Hamiltonian. 
We define the following reduced regularized spectral density : 

(1.7) Sx(/i) := Tr l^{H^)f 

where il) is smooth, compactly supported in a neighbourhood ]E— 5E, E + SE[ of £' G R {5E > 0) 
such that H~^{[E — 6E,E + SE]) is compact {ip^Hy?) is an energy cut-off which is trace class), 
/ is smooth and / (the Fourier transform of /) is compactly supported in R. The case where 
Supp(/) is localised near zero is the one that leads to Weyl formulae, and gives an asymptotic 
expansion of the counting function of (see Theorem 14.51 Corollary 14 .61) . Here we want to 
focus on the oscillating part of Sx(^)- Thus we suppose that ^ Supp(/). 

In order to state the theorem in terms of the reduced space, we need a smooth structure 
on Yie/G, and thus we suppose that the group acts freely on E^;, so that dynamics of H on 
T,E would descend to the quotient. Note that this is not an essential assumption, since we 
have proved the asymptotic without this hypothesis (see Theorem 14.711 . The following result 
involves the quantity x(ff5^)j defined as follows: if tt denotes the projection on the quotient and 
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7 is a periodic orbit in Y,e/G, if 7r(7) = 7, then, there is only one in G such that, Vz g 7, 
M{g^)<^T±{z) — z, where is the primitive period of 7. If 7r(7i) = 7r(72) then g^^ and g^^ are 
conjugate elements of G, and we denote by xiOj) the quantity x(57i) = xig-yi)- 

In order to have a finite number of periodic orbits of the reduced space involved in the trace 
formula, we will suppose that periodic orbits of E^/G are non- degenerate, in the following 
sense : If 7 is a periodic orbit of T,e/G, with primitive period T^, and if n e Z* is such that 

nTiy* g Supp(/), then 1 is not an eigenvalue of the differential of the Poincare map in T,e/G at 
nTj*: ker[((iP-)" — Id] — {0}. Then we have the following result: 

Theorem 1.1. Under previous assumptions, suppose that the group G acts freely on T,e and that 
periodic orbits oJYie/G are non- degenerate in the sense given above. We then have a complete 
asymptotic expansion of Sxi^) ^""^ powers of h, modulo an oscillating factor of the form as 
/i — > 0"'" (see Theorem \4 ■ ?| for details). The first term is given by: 

9^{h) = d^i,{E) y y f(nr^)x(g^e*"^T ^~ ' '"" - + 0{h). 

- 7:" ■ 2^|det((dPy)»-/d)|^ 

7 periodic n £ s.t. /i 

orbit of Se/G nT± e Suppf 

where := Jf^~ PsQsds, Pj is the Poincare map ofj in T,e/G, and a^^n G ^- other terms 
are distributions in f, with support in the set of periods of orbits in Y.e/G. 

Remark 1 : the case with G Supp(/) could have been included in the preceding theorem, and 
we would get a Weyl term in addition to this oscillating part. This term was already described 
by El Houakmi (see ^U]) for the leading contribution. We obtain here slightly more detailled 
asymptotics for the Weyl part, by calculating the contribution of each 17 e G : see Theorem 14 .51 

Remark 2: one could also consider a symmetry directly given in phase space x W^, and 
set G as a finite subgroup of Sp{d, R) . Then we would have to suppose that there is a unitary 
action M : G ^ L{L'^{W^)) which is metaplectic, i.e. satisfies: 

(1.8) M{g)-^Opl{H)M{g) = Opl{Hog), for aU g in G. 

For a fixed g, there is always some M{g) satisfying H1.8|l . but it is not unique (multiply M{g) 
by a complex of modulus 1). The difficulty is to find a M that is also a group homomorphism. 

The method used is close to the one of : unlike articles previously quoted, which used 
an approximation of the propagator exp(— i|-_ff) by some FIO following the WKB method, we 
will use here the work of Combescure and Robert on the propagation of coherent states. This 
method avoids problems of caustics and looks simpler to us. Moreover, the symmetry behaves 
well with coherent states, and we get very pleasant formulae. Thanks to these wave packets, we 
first reduce the problem to an application of the generalised stationary phase theorem (section 
Then we find minimal hypotheses for the critical set to be a smooth manifold, and to ensure 
that the transverse Hessian of the phase is non-degenerate. These hypotheses will be called 
'G-clean flow conditions', and we get a theorical asymptotic expansion of Sx(^) under these 
assumptions fTheorem l4.4f) . Finally, as particular cases, we will show that these conditions are 
fulfilled on the one hand when / is supported near zero ('Weyl term' Theorem 14. 5|l . and on the 
other hand when periodic orbits are non-degenerate ('Oscillating term' Theorem I4.7|l . In both 
cases, we calculate geometrically first terms of the asymptotic expansion, to make quantities 
of the reduced classical dynamics appear, as the energy level, periodic orbits and the Poincare 
map. The symmetry of periodic orbits plays an important part in the result. 

Aknowledgements: We found strong motivation in the work of physicists B. Lauritzen, 
J.M. Robbins, and N.D. Whelan ([TS], [Tn|, |M|)- I am deeply grateful to Didier Robert for his 
help, comments and suggestions. Part of this work was made with the support received from 
the ESF (program SPECT). I also thank Ari Laptev for many stimulating conversations. 
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2. Details on quantum reduction 

2.1. Symmetry subspaces. We recall some basic facts on representations (see |2H| or 
^^): a representation p : G ^ Gl{E) of the group G on a finite dimensional complex vector 
space E is said to be irreducible if there is no non-trivial subspace of E stable by p{g), for all g 
in G. The character Xp : G — > C of a representation is defined by xpid) ■= Tr{p{g)), for g ^ G. 
The degree of the representation p is denoted by d^^ and is the dimension of E. Two such 
representations are isomorphic if and only if they have the same character. We will denote by G 
the set of all irreducible characters, that is the set of characters of irreducible representations. 
Moreover, G finite implies G finite. 

A representation M of G on a Hilbert space is said to be unitary if each M [g) is a unitary 
operator. This is the case of our representation M on the Hilbert space L^(R'') defined by 
()1.5|l since | det((7)| — 1. One can easily check that M is strongly continuous. Then, the Peter- 
Weyl theorem (see ^ or gS]) says that if one set L^(K'') P^{L'^{W^)), where is defined 
by then the are orthogonal projectors of sum identity, and we have the Hilbertian 

decomposition: 

_L 

(2.1) L^{W^) = Ll{W^). 

Furthermore, if x G G, then any irreducible sub- representation of M in L'^{W^) is of character 
X, and a decomposition having such a property is unique. These L^(M'')'s will be called here 
the symmetry subspaces. 

One has to think of them as a certain class of functions of L^(K'*) having a certain symmetry 
linked to G and x- For example, if G = {±/c?Rd}, then we have two irreducible characters x+ 
and X- such that L'^^{W^) is the set of even functions of L'^iW^), and {W'-) is the set of odd 
functions. More generally, if x is a character of degree 1, then x is multiplicative, and we have: 

L^(R'^) = {/ e L^K') : V.g G G, M{g)f = x(5)/}- 

This is in particular the case for abelian groups. If G ~ cr,^ is the symmetric group of permutation 
matrices acting on W^, then there is at least two characters of degree 1: xoi the trivial character 
(always equal to 1), and the signature e. Thus we get: 

- L2^(R'^) = {/eL2(Md) : VaeG, /(:e,(i), . . . , x,(rf)) = /(xi, . . . , x^)}. 

- L2(M'^) = {/ e L2(ijd) . VaeG, /(x,(i),...,x,(<i))=e((7)/(xi,...,xd)}. 

2.2. Reduced Hamiltonians. It is easy to check on the formula (|1.4|l that we have on §(M'^): 

(2.2) M{g)-'Opl{H)M{g) = Opl{HoM{g)), ^g e G. 

Thus we see that the property of G-invariance (|l.l|l is equivalent to the commutation of H with 
all M{g). In particular, it implies that H commutes with all Px's, and thus, L^(R'') is stable by 
H. We can then define the operator that we plan to study: if x G G, set: 

DiHx) ■.= Ll{R^)nD{H), 

The restriction oi H to L/^{W^) is called the reduced quantum Hamiltonian, and is a selfadjoint 
operator on the Hilbert space L^(R''). If / : R ^ C is borelian, then we have: 

[fiH),Px] = 0, DifiHx)) = D{f{H)) n LliR% f{H) = /(iJj P^ 

xeG 

f{Hx) is the restriction of f{H) to L^(R''). Lastly, if a{.) denotes the spectrum of an operator, 

then we have: cr{H) = U <y{Hx) (for details, see 0). 

xeG 

One trace formula will be essential for the rest of this article: 
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Lemma 2.1. // / : M — ^ M is borelian, and if f{H) is trace class on L'^{M.'^), then, for all x G G, 
f{H^) is trace class on L2(R'') and: 

(2.3) Tr{f{H^)) = Tr{f{H)P^). 

Indeed, we have to show that is Hilbert-Schmidt and < l/WI' 

H S 



HS 



which is clear by completing an Hilbertian basis of in an Hilbertian basis of L^(R'^). Then 

one writes: 

Tr{f{H^)) = dim(ifer[/(4) - A]) A 

Tr{f{H)oP^)= dim{Ker[f{H)oP^~X])X. 

Furthermore, if A 7^ 0, then Ker{f{H) oP^~\)^ Ker(f{H^) - A), and we get lfO|l . 

2.3. Interpretation of the symmetry. The investigation of Hy^ provides informations on the 
spectrmn of H: 

Lemma 2.2. If x ^ G then eigenvalues of have a multiplicity proportional to d^. 

Indeed, if F C L^(R'') is an eigenspace of H^, then it is Af -invariant. One can decompose it 
into irreducible representations. By the Peter- Weyl theorem, the only irreducible representation 
appearing is the one of character Xi and thus is of dimension d^^. In particular, the operator 
provides a lower band for the multiplicity of some eigenvalues of H. 

Another remark: by splitting an eigenfunction of H on the symmetry subspaces, we get at least 
an eigenvector in one L^(]R''). This means that each eigenspace of H contains an eigenvector 
having a certain symmetry. As it is well know for the double well potential (G — {±/d}), 
where eigenspaces are of dimension 1, this leads to an alternance of even/odd eigenspaces and 
to tunneling effect. 

If N^{I) denotes the number of eigenvalues of (with multiplicity) in an interval / of M, 
and N{I) the one of H, then the quantity Ny^{I)/N{I) can be thought as the proportion of 
eigenfunctions of symmetry x among those corresponding to eigenvalues of H . 

2.4. Examples. We give a few examples of Schrodinger Hamiltonians with a finite group of 
symmetry: 

H{x,0 := \e + V{x). 

(1) G = {±/rf} : double well: V(x) — {x^ — 1)^, harmonic or quartic oscillator: V{x) — x^ 
or a;"*, 'the well on the island': V{x) — {x^ + a)e^^ {a > 0). For the two first examples, 

V{x) > -foo, so H is essentially selfadjoint on §(M) and with compact resolvant. 

+00 

(2) G ~0"2i d ^ 2: any potential satisfying V{x,y) = V{y,x). 

(3) Group of isometrics of the triangle, d = 2: V{x,y) — \{x^ + y'^Y ^ ^V^ + ^ which 
in polar coordinates is V{r^O) = V{r cosO^r sm9) — ^r^ + ^r^ cos{39) (see also the 
Henon-Heiles potential: V{x,y) = 5(2^^ + Z/^) ^ xy^ + l^'^' '^^^ ^'^ look for the 
selfadjointness of this operator). 

(4) Group of isometrics of the square, d — 2: V{x, y) — ^x^y^. 

(5) G ~ (Z/2Z)'^: harmonic oscillator with distinct frequencies: V{x) ~< Sx,x >Kd, with 
S symmetric positive definite matrix with eigenvalues pairwise distincts. In this case, 
H is still essentially selfadjoint on S(K'*) and with compact resolvant. This is one of the 
few cases where we can calculate periodic orbits of the dynamical system. 
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3. Reduction of the proof by coherent states 

We adapt here the method of 7 . The essential tool is the use of coherent states.^ We refer 
to the Appendix where we recall basic things about it (se also jjj, or jHI). Note that, by an 
averaging argument (see section !?!^ , we could already restrict ourselves to a group of isometries. 
For the moment, we still use the general expression of l|1.3|) . to keep in mind the symplectic form 
of M{g). We suppose that ip and / are in §(IR) such that Supp(i/') C\E — dE,E + 6E[ and 
the Fourier transform / of / is with compact support. We know from jl5|. j25|. that, under 
hypothesis H3.5|l . ip{H) is trace class for little /I's, and, by formula H2.3|l . we have: 



\G\ 



where: 



(3.1) I,{h) := Tr (^^(H)/ [^J^j Mi9)j • 

Then, by Fourier inversion, we make the /i-unitary quantum propagator Uh{t) :~ e~''i^ appear, 
and write: 

(3.2) Ig{h) = /■ e'^./>).Tr U{H)Uh{t)M{g)) dt. 
Then we use the trace formula with coherent states - see H5.4II - to write: 

(3.3) /^(/j) = (MU! /■ /■ e''-i.f{t).mHia,t,g)dadt. 
where 

(3.4) mh{a,t,g) :=< Uh{t)(pa; M{g)'~'^'ilj{H)ipa >mwd.) ■ 
With exactly the same proof as in j7j, we get the following lemma: 
Lemma 3.1. There exists a compact set K in R^'' such that: 

\mh{a,t,g)\da = 0{h+°^). 



uniformly with respect to g £ G and t G R. 

We can then suppose that := {H = E} is included in K, and choose a real cut-off function 
Xi, compactly supported in R^'' and equal to 1 on K. We can write I — xi + {I — Xi) in l|3.3|) . 
and settle problems at infinity in a. Besides, we want to use the functional calculus of Helffer 
and Robert ([El, [21]) for the description of ip{H). Thus we make the following hypothesis: 
3C > 0, 3C„ > 0, 3m > such that: 

( <H{z)><C <H{z')> .<z-z' Vz,z'eR2''. 

(3.5) <^ \d^H{z)\<Cc,<H{z)>, Vz e R2'',Va e N^'*. 
[ H has a lower band on R^''. 

Then, we can write for A'o € N: 

No 

(3.6) V(i?) = J2 ^'Opl{a,) + /i^«+i.i?Ar„+i(/i). 

where Supp(aj) C H-^{]E^5E,E + 5E[), ao(z) = ijj{H{z)), with Sup ||i?Ar„+i(/i)||rpj. < Ch-"^. 

Q<h<l 



^More details on the proof can be found in 



REDUCED GUTZWILLER FORMULA WITH SYMMETRY: CASE OF A FINITE GROUP 



7 



We obtain 
(3.7) 



No 



lg{h) = ^ hn^gih) + 0(/i-''/l^«+l). 

3=0 

Now, we must get a complete asymptotic expansion for a fixed jo in N of the quantity: 

(27r/i)-'' 



(3.8) 

with 
(3.9) 



P<>ih) 



27r 



e' " .f{t)xi{a)mjl>{a,t,g)dadt, 



m]"{a,t,g) :=< Uh{t)(pa; M{g) ^Op'^{aj„)(pa >L2(Rd) 



For the right term of the bracket in f.V..^)) . we expand Op'f^{ajg)ipa in powers of h, by Lemma 3.1 
of [7]. Thanks to H2.2() . since T/i(a) = Op™(exp(^(px — gO) ~ see Appendix - we can write: 

M{gr'7hia) = 7n{M{g-^)a)M{g)-\ 

For the left term of the bracket in J^8.y\) . we use the theorem of propagation of coherent states 
given by Combescure and Robert ([H], |3 or [2SI)- If M e N, then we have: 

M 

J2hibj{t,a){x).ei<^''>'-''^> 

3=0 



M + 1 

<CM,T{a).h 2 



where at — ^t{o) is the sohition of the system (|1.2I) with initial condition a (see Appendix for 
other notations). After all, since there is no problem of control for a at infinity, we get: 

27V 2N-k , 

(3.10) m^(a,t,g) = Y. E E ^^^^ e^"^ T,,,(a, i, g, /.) + 0(rt^+^), 



/c=0 3=0 |7|=fc 



with: 



T,^^{a,t,9,h) :=< T„(aOA^6,(i, a)e5<^»-'->; T„(M(g-i)a)Aa?(g)-iQ^V^o > 
where is the polynomial in d variables such that: 

(3.11) Op5"(z^)^o=Q7-^o 

We have: Kl7h{-M{g'^)a)7h{at)l^h = e27r<A^(s"')"^"'"t>Ti (^£iz:i!£kl>^ (see Appendix). 



Thus: 

T,,^{a,t,g,h) = e^<M{9-')<^J<^.> < 
We will use the notation: 



^/h 



b,{t,a)ei<^<^^'^>,M(g)-'Q^^o 



{q,p) eR'' xR'' and {qt,pt) := at = ^t{ct). 

Make the change of variable: g~^y := x — {qt — g^^q)/Vh in the previous <; >l^. Since G is 
compact, I dct((7)| = 1, and we obtain after calculation: 



Tj^ry{a,t,g,h)=T: ^e'* 

where 
(3.12) 

Then we set 



A:=I-'g-^Mog-\ and f3 := ^[{q - gqt) + iCg'^pt - p)]. 



Q^{x) =: and bj{t,a){x) —: Ci,j{t,a)x'^ 

\^A<h\ W\<33 
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(where Ci/j- is smooth in t,a). For the same reasons as in j7] (parity of Qj and bj(t,a)), only 
entire powers of h have non-zero coefficients. Then, we can expend and bj{t, a) and use the 
foUowing calculus of the Gaussian: 

Lemma 3.2. Let A G Md(C-) such that *A = A, and that is a positive definite matrix, 
/3 E and a G N"*. Then A is invertible and 

I ^_i<A.,.>+/3.^a^^ ^ {2^)idet'^^{A)e^<^"'^^'^> V (A-i/?)''P,(A), 

where Pri{A) doesn't depend on (3, and P^{A) — 1 (for a precise definition of detj^^ , see 
We get: e^-^^e^:''^*'") T j^^{a,t, g, h) = 

X [(/-zV'A/o5"')"'(/3o)]V,(A)/i-^(l-l+l''l)exp(^^^£;(t,a,5) 
where (3q := Vhp, and: 

(3.13) ipE{t, a, g)=tE + S{t, a) + qp -* gpqt + ^\gqt - - ^ < ^~^/3o, Po > ■ 

Thus, and give: 

, , wd 27V 2N-k , s 

e^) = ^E E E E E ^(2-)^ E ( : ) ^.^^^.^..e^) + o[h--\-% 

with: 
(3.14) 

L^,u.f,.',,Ah) := V / / exp ( ^(^B(i,a,g) ) /(t)a'>'aj„(a)xi(a)£'a,^,i.j(i,a,5r)dadt. 

where: D^^ri,u,j{t, a, g) := 

(3.15) c,,, (t, a)det7 (/ - i'g~'Mo g'^)PM) [^"' [(? - mt) + i ('.g" V - p)]] " (ffft - g)"- 
A tiresome but straightforward computation gives from H3.13|l and (|3.12l) : 

\ ipi{t,a,g):={E^H{a))t + \<M{g)-^a,Ja>-\ f {at - M(g-^)a)Jd,ds 

(3.16) <^ . 2 2 7o 

[ V2{t.a,g) := ^ < (/ - Wt)(M(5)at - a); (M(5)at - a) > . 
where Wt := ^ with i(/ + Wt) := (/ - M^g-^yK 

Lemma 3.3. We have: WWiW^^f^d-^ < 1- 
Proof: we introduce the Siegel half-plane: 

Y,a :== {Z G Md(C) Z ^ Z, and 3Z is positive definite }. 
We know from 12_ pp.202, 203 that if Z G Sd, then - iZ)-^{I + iZ)\\^^^^^ < 1. Now, we 
can take Z =* g~^ Mog~^. Indeed Mq is symmetric, and, since Fa{t) is symplectic, we have: 

yx G '^CX.MqX) = \iA + iB)-^x\l,. 
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ThusZe Sd. The proof is clear if we note that {I - i^g-^ Ma g^^y^il + i*9^^ Mq g^'^) = Wt.D 

We are led to solve a stationary phase problem to get an expansion of each L^^i^^^,^ in 
powers of h. 

Remark: Note that the term D^r^rj.iyj ^ H3.15|l - and its derivatives will be vanishing on the 
critical set of the phase for derivatives up to \a\ + \ri\ (see (|3.15(l and H4.1|l l. Therefore, the as- 
ymptotic of Jjj^ J-g2d ■ ■ ■ dtda will be shifted of h to the power ^(|ct| + I77I). This fact compensates 

for the term in at the beginning of the expression of Lrj^u,ii,-y,j{h) in ()3.14|l . 

4. The stationary phase problem 

Now, we fix g in G and we want to find the conditions under which we will be able to apply 
the stationary phase theorem under the form of [3| (Theorem 3.3) on Ljj^^^^^^j^h). A necessary 
and sufficient condition will be called '5-clean flow'. Then we will give particular cases for which 
this criterium is satisfied (see sections l4 . 21 and [4 . 3|) . Our method will first consist in calculating 
the critical set of the phase (pE and its Hessian. Then we will calculate the kernel of this Hessian, 
and, under assumption of smoothness of the critical set, we will describe the conditions for this 
kernel to be equal to the tangent space of the critical set. In this section, since g is fixed in G, 
we will denote ipE{t,z,g) by LpE.,g{t,z), for z £ W'^'^ and t e K. 

4.1. Computations and g-clean flow. 

• Computation of the critical set 

Let eE,g := {a e M X R^"^ : Q{ipE,g{a)) = 0,VipE,g{a) = 0}. 
Proposition 4.1. The critical set is: 

(4.1) GE^g = {{t, z) e R X R^-* : z e Eb, M(5)$t(z) = z}. 

where {t, z) 1-^ ^t{z) is the flow of the system jJ.^) . 
Proof : 

'i^Eit, z,g) = g?^2(i, z,g) = ^\zt - M{g-^)z\^ ' \^ < Wt{M{g)zt - z);M{g)zt - z >r2. . 
We note that, if a and b are in R'', then: 

< Wt{a, b); (a, b) >^2d=< Wt{a - ib); (a - ib) >Rd . 

Thus, 

QipEit,z,g) = ^ \zt-M{g-^)z\'' =^<WtP,P>K^=^<WtP,P>c^, 

where 

P ■= {mt -q) - iCg^^pt - p)- 

Therefore, by lemma rOI we have: QipE{t, z, g) — -<=4> $t(z) — M{g^^)z. 

-Computation of the gradient of (pi : 
r dtifiit, z,g)^E- H{z) -\<{zt- M{g'^)z); Jzt > 
\ V,^i(t, z,g) = i(*M(.g-i) +* F,Xt))J{zt ~ M{g-^)z) 

-Computation of the gradient of ip2 '■ 

AdtP2{t,z,g) = 2 < {I-Wt){M{g)zt - z)-M{g)zt >-< dt{Wt)iM{g)zt - z); {M{g)zt - z) > 
AW,Mt,^',9) = 2CF,{tYM{g) - I){I ^ Wt)(M{g)zt - z) -* [d,{Wt){M{g)zt - z)]{M{g)zt ~ z) 

Thus, we see that {t,z,g) g C^.g if and only if ^t{z) = M{g^^)z et H{z) = E. □ 
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• Computation of the Hessian Hess ipE,g{t, z) 

We first need some formulae coming from the symmetry that will be helpful for the compu- 
tation: We recall that Fz{t) — dz{^t{z))- By differentiating formula we get: 

(4.2) VH{M{g)z) M{g-^)VH{z), Vz G M^d^ ^ q 

This formula implies that we have also: 
(4.3) 

<^t{M{g)z) = M{g)^t{z), Vz G M^'^, V.g G G, Vt G R such that the flow exists at time t. 
Moreover we recall that, since M{g) is symplectic, we have: 

(4.4) JM{g) M{g-^).J and M{g)J = .PM{g-'^). 
Finally, if t and z are such that M(g)^t{z) = z, then we have: 

(4.5) {M{g)F,{t) - I)JVH{z) = and (*F,(t)*Af(g) - I)VH{z) - 0. 

The second identity comes from the first since M{g)Fz{t) is symplectic. For this first relation, 
one can differentiate &i s — t the equation: 

^t{M{g)^s{z)) = <^s{z). 

With these formulae, it is easy to find that: 

Proposition 4.2. Hess (pE,g{t, z) = 



/ 5 < (/ - Wt)J\7H{z); J\/H{z) > 



1* 

2 



-*VH{z) ^ 
(*F,(i)*Af(5) - /)(/ - Wt)JVH{z) 



^[JM{g)FAt) -HM{g)FS))J] 



-VH{z) ^ 
\ +^{'F,{tYM{g) - I){I -Wt)JWH{z) 



+ \{'FMM{g) - /)(/ - Wt){M(g)Fz{t) - I) J 
• Computation of the real kernel of the Hessian 

If ^ G Af„(C), then we define kerj,(A) := {x G M" : A{x) = 0} = ker(3fi(A)) n ker(5(A)). 
Proposition 4.3. Let {t, z) G &E.,g- Then the real kernel of the Hessian is : ker„ Hess (pE,g{t, z) = 

(4.6) {(T,a) G M X R^'' : a _L VH{z),tJVH{z) + {M{g)Fz{t) - Id)a = 0}. 

Proof : Let r G M and a G M^''. We set: 

X := tJVH{z) + {M{g)F,{t) - I)a. 

Let us denote by Wi and W2 the real and imaginary part of Wt- Then, (r, a) G ker^ Hess ipE,g{t, z) 
if and only if: 

(4.7) < W2JVH{z);x >= 2 < \7H{z);a > . 

(4.8) < (/- Wi)JVi/(z);x >= 0. 

(4.9) {'F,{tfM{g) - /)(/ - Wi)x = 0. 
and 

~2t^H{z) + [JM(g)F,{t) (M{g)F,{t))J]a + {'F^Mig) - I)W2X = 0. 
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We multiply this last identity by {M{g)Fz{t))J, we note that W2 = JWi and recall that 
M{g)Fz{t) is symplectic to obtain the equivalent identity: 

(4.10) {M{g)F,{t) - I){Wi - I)x = 2x. 

Now, if (t, a) e ker„ Hess (pE,g{t, z), then, by H4.1()|l and (|4.9(l . we have: 

< x, (/ - Wi)x >= 0, i.e. \x\'^ =< Wix, x > . 

By lemma 10 Wi ^ < 1, thus x = 0, and by l|T7jl . VH{z) _L a. 

Conversely, if a; = and VH{z) _L a, then, we have 14.7|l . (|4.8() . (|4.9|l and l|4.1()(l . Thus 
(r, a) e ker„ Hess (pE,g{t, z). □ 

We are now able to describe the conditions under which we can apply the generalised station- 
ary phase theorem on L^^^^^^.yj{h): we easily check the positivity of the imaginary part of the 
phase fE.g by lemma Moreover, if Qe^q is a union of smooth submanifolds of M x M?'^, if 
X G then the Hessian of tpE,g{X) is non-degenerate on the normal space NxGE,g if and 

only if ker, Hess (pE,g{X) C TxGE,g, the tangent space of CE,g at X. Besides, note that, by the 
non-stationary phase theorem, we can restrict this hypothesis to points X in Supp(/) x Supp(aj(j). 



Definition: let g e G,T > 0, such that Supp(/) c]-r, T[, and * 



g 



] -r,r[xS£;^M2d 

{t,z)^M{g)^t{z)-z 

We say that 'the flow is g-clean on ] — T, r[xS]£' if zero is a weakly regular value of ^E", i.e. : 

• ^'"^({0}) =: GE,g is a finite union of smooth submanifolds of K x K^''. 

• V(<, z) e eE,g, T(t,z)*^E.,g = kerd(t,^)*g. 

We say that 'the flow is G-clean on ] — T, r[xl]£;' if it is (?-clean for all g in G. 

By proposition 14. HI we see that if (t, z) £ GE,g, then ker(i(( ^jVE'g = kerj, Hess (pE,git, z). Thus, 
if we only know that the support of / is in ] — T, T[, then the g-clean flow condition is the minimal 
hypothesis under which we can apply the stationary phase theorem to Lr,.,j^^^-y.j{h). Therefore, 
we can state the theorem: 

Theorem 4.4. Reduced trace formula with G-clean flow. 

Let G he a finite subgroup of Gl{M.,d) and H : M^'' ^ M a smooth Hamiltonian G -invariant. 
Suppose that E M. is such that there exists SE > such that H^^([E — SE,E + SE]) is 
compact, and T^e = {H = E} has no critical points. Make hypothesis 5\} . Let f and ■0 be real 
functions in §(R) such that Supp{'ip) (l]E— 5E, E + 5E[ and f is compactly supported in]~T, T[, 
where T > 0. Suppose that the flow is G-clean on] — T, ^[xEb. Then the spectral density 

SxW = ^ E ^^Mh) - see {73, 
' ' see 

has a complete asymptotic expansion as /i — *■ 0^. Moreover, if g d G, and, if [GE,g] denotes the 
set of connected components of Qe.q, then the quantity psqgds is constant on each element Y 
of [C£;,g], denoted by Sy.g, and we have the following expansion: 

IgAh)^ J2 (2^/i)^"^et'5-.«-L I /■ f{t)^i;{E)dgit,z)daY{t,z) + J2h'a,A+Oih+°°) 

where Oj^y o,re distributions in f ® [tl; o H) with support in Y , and the density dg{t, z) is defined 
by: 

(4.11) dgit, z) :. dct-^ { ^'^--^'^^'-'->-^ dct-^ (A^.B-^iG^ ^L,) 
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VE.g is given by ^3.16]) and A, B, C, D are the d x d blocs forming the matrix Fz{t) := dz{^t{z)) 
(see fOpj. 

Remark: without symmetry, this theorem can be compared to articles of T.Paul and A.Uribe 
(cf [25 and [221) to ttie Gutzwiller formula in the PhD. thesis of S.Dozias (jH), see also [2n]- A 
notion of clean flow is also present in 7 . The density dg{t, z) is difficult to compute in general, 
even without symmetry. The purpose of next sections is to calculate it in two special cases: 
when / is supported near zero (Weyl part) , and under an assumption of non-degenerate periodic 
orbits of the classical flow in (oscillating or Gutzwiller part). 

Proof : as we have seen before, we can apply the stationary phase theorem on each i/^^^^j (ft), 
which gives an expansion of each /^"(/i) and each Ig{h). The flrst term is given by: 

I,ih) ^^^^ IML! £|^^^,,(«)/(,)^(^(«))det7 (^^±^^^i(£±M) et-.^(*-)dMa. 

By definition of C^^g, ^PE.g is constant on each connected component of Cb,^, equal to: 

(pE,g{t,a) ^ S{a,t) + Et = / PsQsds, where (gs,Ps) = <i>s(a). 

Jo 

This ends the proof of theorem 14.41 □ 

4.2. The Weyl part. We now deal with one case which leads to an asymptotic expansion at 
the first order of the counting function of in an interval of M. Fix g in G and define: 

(4.12) LE,g ■.= {teR: 3z e : M{g)<i>t{z) = z}. 

Theorem 4.5. Let G be a finite subgroup of Gl{M.,d) and H : K^"* ^ K. a smooth G-invariant 
Hamiltonian. Let E £ M. be such that H~^{[E — SE, E + SE]) is compact for some SE > 0, and 
that T^E = {H — E} has no critical points. Make hypothesis ^3. 5p . Let f and ip be real functions 
in 8(M) with Supp{ip) (l]E — SE,E + 6E[ and f is compactly supported. For g in G, we set: 

Vg :— dimker((7 — Id^d), Eg :— ker^M^g) — Id^2d) and Eg :— kei^g — /dRd). 

Set Ig{h) :— Tr [%l}{H)f ^ ^fj^ ^ ■ Then, under previous assumptions, we have: 

- If Suppf^ n iLfi^g = 0, then Ig^sih) = 0{h+°°). 

- If Suppf n )^E,g — {0} then we have the following expansion modulo 0{h^°°) : 

(4.13) Ig^x{h)-h^-''<'Y.Ck{f,g)h\ ash^O+. 

k>0 

uniformly in X in a small neighborhood of E, where Ck{f,g) are distributions in f with support 
in {0}, and, if d{Y2\ n Eg) denotes the euclidian measure on Yi\ n Eg, then we have: 

(4.14) = *(A)/(0). l^''-- ' "l^^^'^-'W 



det((/4- -s)|jii) Js.nF, |VH(z)| 

g a 

Remark 1: the oscillating term of Theorem 14.41 is now vanishing, since, for g G G, Sy.g — 
when Y = {0} x (E^jiHFg). Moreover, it is easy to see that, since 'Se is compact and non-critical, 
zero is isolated in ^E,g- Thus the hypothesis Supp/ n LE,g = {0} is fulfilled if / is supported 
close enough to zero. 

Remark 2: we slightly precised the previous result of Z. El Houakmi given in [TH] . by the 
computation of 1)4.14(1 . Note that the leading term of Sx(^) is obtained for g = Id, and: 

SxW = ^V^(i?)/(0)(2^M'-'^/^ ^^+Oih^-'), as/.-.0+. 
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Proof : If Supp/ (lUE.g — 0, then (Supp(/) x M^'*) n QE,g = 0, and by the non stationary phase 
theorem, we get the result. 

Now suppose that Supp/ H Le.q = {0}. Then we have: 

(4.15) eE,g n (Supp(/) X R"") = {0} X {j:e n Fg). 

We now give some 'trick' to boil down to the case where G is composed of isometrics. We recall 
that, since G is compact, there is some Sq, symmetric c? x o? positive definite matrix, such that: 

(4.16) Go := S'(7^ G5o is a subgroup of the orthogonal group 0(d, M). 

One can indeed classicaly find a scalar product invariant by G by averaging with the Haar 
measure of G. Thus, we can define a new Go-invariant Hamiltonian: 

^0 



Hoiz) H{M{So)z), where M{So) := 



*5o- 



If X G C, then one can define xo '■ Gq C by: 

Xo(5o) xiSogoSg^). 

Then it is easy to check that xo G and that the application X i— > Xo is bijective from G to 
Gq. Moreover, identity H2.2|l implies that: 

OK(iJo) = Al{So)-'Op]^{H)M{So). 

If X G G, then we can define: 

Then we have P^g — AI {Sq)^^ P^M (Sq) . Therefore, if f{H) is trace class, then /(i?o) also, and 
we have: 

Tr(/(i?^)) = Tr(/(i/)P^) = Tr(/(iJo)4o)), 
by cyclicity of trace. This remark apply in particular for the trace (|1.7|l . Moreover, if g G G, 
if 50 := Sf^^gSo, then Th:{f{H)M{g)) = Tr(/(.H"o)M(go))- Finally, it is easy to check that hy- 
potheses for (_ff, G) are available for (7?0; Gq), and that coefficients of the asymptotic have the 
same expression in terms of (iJo, Go) as in [H , G). □ 

From now on, we suppose that G is made of isometrics, without loss of generality. 
First, we remark that Yje and Fg are transverse submanifolds of M^''. Indeed, if z € H Fg, 
then, by H4.2|l . since g is an isometry, we have VH{z) e Fg, thus Fg + [KVi7(z)]-'- = K^''. 
Therefore 

T(o,.)e£;,g = {0} X [Fg n [m/H{z)]^]. 

If (r,a) e kerj,Hess (/9£;(0,z) then by Proposition Ol tJVH{z) + {M{g) - l2d)a = 0. Then 
one can take the scalar product of this equality with J\IH{z) to obtain t — Q and thus, 
kerR Hess (/p£;(0, z) = T(Q,z)^E.g- This means that we have the theorical asymptotic expan- 
sion of Theorem 14.51 

Now, we have to compute the leading term of this expansion. Here again, we can suppose 
that g is an isometry, which simplifies the calculus: in particular, [M{g), J] = 0, when t = 0, we 
have Wt — 0, and ^^(0) = Id. By Proposition ^21 we obtain: 

-*VH{z) 

-VH(z) y{M{g) ~ M{g'')) + 1(J - M{g)){I - M(g-')) 

We have J^^o^.-^GE.g = K x [F^ + M.\/H{z)]. Let (3o be a basis of F^. We set: 

eo:=^ = (l,0), £o:=(0,ViI(z)). 



}iessipEAO,z)- I 5lVJ/(^)" 
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Let /3 be the basis of 'N(^Q^z)^E,g made up of (in this order) cq, Eq and /?o- We note that the hnear 
appUcation \ j{M{g) - M{g-^)) + |(/ - M{g)){I - M{g-^)) stabihzes the space F^. Then by 
calculating the determinant of the restriction of Hess (Pe{Q, z) to ?Sf(o,z)C£;,g m this basis, we get 
(noting Ji := 'y^(o,z)QE,g)- 

det (^^I^MJ^^ ^ |vi/(z)|2 det jJmg) - M{g-' j) + i(/ - M{g)){I - M{g-')) 

If lig is the orthogonal projector on Fg, then we have: 

^^_det ('^ksl^llllA - ( h{h-9){h-9-')+l^cj\ U9-9-') 



Then, since g is an isometry, we can suppose that g is bloc diagonal with blocs /p^, ~Ip2, 

Rg, , ... .Re , where »i + B2 + 2r = d, 0j's are not in ttZ, and Rg ( '^'^'^^ sin 6* \ 

\^ smt^ cosfc* J 

then use the fact that g commutes with Hg, and that when [C, Z?] = 0, then det(^ ^ ^ 

= det(AI? — BC), for any blocs A, B, C, D of same size. A straightforward calculus then gives 
(see for details): 



Since 



det_|_' 



2 



det, we have: 

det7 ( ^"^^"'^^'-'"- ) =±|ViZ(.)||det(/.-,),^J. 

We can proove that the factor ±1 is in fact equal to 1, either by coming back to the calculus 

_ 1 

of det_|_^ with gaussians, or, classically, by using a weak asymptotic, i.e. by calculating the 
asymptotic of Ti{ip{H)M{g)), when 1^9 : R ^ R is smooth and (p{H) is trace class. See for 
details. 

Using (|4.11() . the fact that the phase vanishes on Cs.g, and that dim(e£;,g)n(Supp(/) xR^'') = 
2iyg — 1, we obtain the result we claimed. This ends the proof of Theorem l4.5l □ 

As a consequence of Theorem 14.51 near t = 0, using a well known Tauberian argument (see 
|25j). we get the following: 

Corollary 4.6. Let G be a finite group of Gl{d,R). H : M?'^ ^ R a G-invariant smooth Hamil- 
tonian satisfying Let Ei < E2 in R, and L :— [Ei,E2]. Suppose that there exists e > 

such that H^^{[Ei — e,i?2+e]) is compact. Furthermore suppose that Ei and E2 are not critical 
values of H . If G, then the spectrum of is discrete in I, and we have: 

Nj,^ih)^^^{27Th)-^Vol[H-\l)]+Oih^-^), 

where Ni^^{h) is the number of eigenvalues of in I counted with multiplicity. 

Remark: One can interpret this result by saying that, semi-classically, the proportion of 
eigenf unctions of H having symmetry x is jq-^. In particular, the same proportion of eigenvalues 
has multiplicity greater than d-^. The more d-^ is high, the more L'^{W^) takes part in the 
spectrum of H. 
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4.3. The oscillatory part. If 5 e G and 7 is a periodic orbit of globally stable by M{g), 
we set : 

Hg^^ := {t e Supp/ : 3z e 7 : = z}. 

If to £ ^g,^i 2 G 7, then P-y^g^to denotes the Poincare map of 7 between z and M{g~'^)z at time 
to, restricted to Yje- The characteristic polynomial of dPj^gfy doesn't depend on z e 7. Note 
that, by iterating formula (|4.3(l . since G is finite, if we have M{g)^t{z) = z, then z is a periodic 
point of the Hamiltonian system H1.2|l . 

Theorem 4.7. Make the same assumptions as in Theorem \4-5\ but suppose that ^ Suppf. 
Make the following hypothesis of non- degeneracy : if ^ C S^;, is such that 3g £ G and 3to € ^g,^; 
to 7^ 0, then 1 is not an eigenvalue of M(g)dPj^g_to. Then the set of such 7 's is finite and the 
following expansion holds true modulo 0(/i+°°), as /i — > 0^ ; 

SxW-^ E E ^ E e^^^('")E'ir*°(/X- 

7 periodic g ^ G s.t. tQ G ^g,"/ fe^O 

ortii 0/ Ee A/(s)7 = 7 to # 

Terms dl'^''°{f) are distributions in f with support in {to}, Sj{to) :— psQsds, {{qs,ps) :— 
<i>s(z) with z € 7), and 

■ih( FAT* e'-i'^-''^3,to) 

° 2n\Ael{M{g)dP^,g,t,-Id)\h''^' 

where T* is the primitive period of ^ and a-y{g,to) G Z. 

Example T. if d = 1, periodic orbits are always non-degenerate. For example, in the case of 
a double well Schrodinger Hamiltonian, one can illustrate the sum of Theorem 14.71 on figure ^ 
picturing the classical flow in IR^: some periodic orbits appear only for g = Id in the sum, and 
others arise for both g = ±Id. One can also fold the picture to compare with the periodic orbits 
of the reduced space as in Theorem 11.11 




Figure 1 . Double well phase portrait 



Example 2: if is a Schrodinger operator on R'' with potential V{x) =< Sx,x >, where 
S is the diagonal matrix with diagonal non- vanishing w^, . . . ,w'^, if one assumes that Vi j, 
Wi/wj (f. Q, then periodic orbits appear as a union of d plans, with primitive periods T* = ^ 
and are all non-degenerate. 

As a particular case of this theorem, wc get the Theorem ll.il 

Proof of Theorem \l.l\ if we suppose that G acts freely on Y^e, then Yie/G inherits a struc- 
ture of smooth manifold such that the canonical projection TriE^j^S^/Gis smooth, and the 
dynamical system restricted to E^; descends to quotient. If to G I^*, G G and z e E^;, with 
orbit 7, are such that M[g)<^to{z) = z, then 7 and 7r(7) are periodic. If P^,-.^-) ,^(2) (^o) denotes 
the Poincare map of 7r(7) at time to, then we have: 

(4.17) det(M(5)4P7.9.to - Id) = detK(,)P^(^),,(,)(to) - Id). 
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Indeed, if $t denotes the flow in Y.e/G, then one can differentiate the foUowing identity on E^; 
with variable z: 

to get the the identity: 

d^TTo M{g)F^{to) = -FV(z)(io) o d^ir, 

where f^(2)(io) is the differential of x i-^ ^toi^) a-t tt{z). Moreover, tt is a submersion, and by a 
dimensional argument it's also an immersion. Thus we have H4.17|l . 

Therefore, if we make hypotheses of Theorem ll.il then hypotheses of Theorem l4.7l are fulfilled. 
If z G is such that the orbit of 7r(z) is periodic with period to ^ 0, then there is only one 
g — g-y E G such that M{g)^ta{z) = z. If iL^ed denotes the set of periods of Yje/G, then we 
have: 

E E E E E E-- 

7 periodic g e G s.t. to £ -^g.-y ^0 ^= red 7C :7r (7) periodic ff — p^ 

orbit of ^'^{9)^ — 7 to 7^ witli to f^^^ period 

If we denote Stab{'^) :~ {g E G : AI{g)^ — 7}, then we have Stab{'j) —< g^ > and it is easy to 

T* 

see that T*^^-^ = . If we denote by N^^^-y) the number of orbits of S^; with image 7r(7) by 

TT, then we have N^^^^) = | G|/| 5^06(7) |. Thus we have: 

toe^.e. 7CS,:.(7) periodic A'.(7) 27r | dct K (,) (^) (,) (^0 ) " M) h 

witli to for period 

Then one can show that quantities appearing in the r.h.s. don't depend on 7 but only on 7r(7), 
and this proves the Theorem ll.il □ 

Proof of the Theorem\Jl\ We fix g in G. If IqER*, we set: 

^E.,g,to ■■= {7 orbit of Eis : 3z E j : M{g)<^>ta{z) = z}. 

Lemma 4.8. // we make assumptions of non- degeneracy of Theorem \4. 7| then I^E,g H Supp{f) 
is finite and we have: 

(4.18) eE,gn{Supp{f)xR^'')= U U {to}x7. 

Proof : one can adapt the proof of the cylinder theorem of For details, we refer to 0. □ 



Note that periodic orbits appearing in this critical set are the ones stable by g. 
e see that eE,g n (Supp(/) x E^'') is a submanifold of M x R^^' and if {to, z) E ^E.g, 



have: 

T(t„,.)e£,g = {0} X RJVHiz). 

To apply the stationary phase theorem, we have to show that ker^ Hess (pE.g{to, z) C T(^to,z)GE,g- 
Let (r, a) E ker^ Hess ipE,g{to, z). By Proposition we have a _L VH{z) and: 

(4.19) tJVH{z) + {M{g)F,{ta) - I)a = 0. 

If A e R, we denote by := X^fcli ker(M(g)F2(to) - Id)^. Let 7 be the orbit of z. Since 1 
is not an eigenvalue of M{g)dP^^g^tg, 1 is an eigenvalue of M{g)Fz{to) of multiplicity 2. Thus 
dimi?i = 2. Using H4.5|l and 14.19(1 . we have a E Ei. Let U2 E R^'' such that {J\7H{z),U2) is 
a basis of Ei. Note that < U2,VH{z) >^ 0, otherwise we would have U2 E {JEi)^, which is 
equal to © E\ since M(g)Fz(tQ) is symplectic. Since a E Ei we have Ai, A2 in R such that: 

A#l 

a = \iJVH{z) + A2M2- 
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Then, using the fact that < a,WH(z) >— 0, we get A2 = (since < U2,Vi/(z) >^ 0). Thus 
coming back to H4.19|l . we get r = and a G MJVi7(z). Thus (t, a) e T(tQ.z)^E.g- 

This shows that we can apply the stationary phase theorem and get a theorical expansion of 
Ig{h) and SxC*)- We have now to compute the first term of this expansion. We suppose that 
{to, z) e e^^g. We denote by 11 the orthogonal projector on RJVi7(z). We set F := M {g)Fz{to) 

and W :— Wtg- Then we have: det 



•'(tO.^)^-E,3 _ 



/ 5 < (/ - W)J\'H{z); JVi7(z) > 



det 



-iVHiz) 
V +U*F - --W)JVH{z) 



-\'VH{z) 
-\'[{'F-I){I~W)JWH{z)] 



\ 



^[JF+* (JF)] 
-i(*F-/)(/-M^)(F-/)+n / 



Since F is symplectic, we have JF +* (JF) = (*F + /) J(F - /). Set: 
(4.20) K 



h'F + I)J+\{'F-I){I-W). 



Then, the forth bloc is equal to K[F - /) + 11. 

Using H4.5|l . we note that the third bloc is equal to KJVH{z). Let us set: 
(4.21) Xi:^\{I -W)J\IH{z). 



We then have: 



det 



det 



^XiJ\JH{z) 


i*WH{z) - 


Xi{F-I) 


KJVH{z) 


K{F 


-/) + n 



The following technical lemma is due to M. Combescure (see j2| in the preprint version or j^] 
p. 87 for the proof): 

Lemma 4.9. K is invertible and K^^ = i[(F - /) + i{F + I) J]. 

Moreover, if we set F ^ ( ^ ^ V then det{K) ^ {-i f det{^{A + iB - i{C + iD)))-\ 



Since 



det 



= det 



1 




/ *XiJViJ(z) 


i^VH{z 


)+* Xi(F-/) 







JVH{z) 


(F- 


r) + K-^ii 



*XiJVH{z) 


i*WH{z) +* Xi{F- I) 


JVH{z) 


{F - 1) + K-^n 



using H4.11|l and the preceeding lemma, we get: 

(4.22) dg{t, z)-2 = (-l)'' det{g-^) det 

We denote by a .=< Xi, JVH{z) >^ and we use the line operation L2 ^ L2 — ^ JViJ(z)Li, to 
get: 

(4.23) dg{t, z)-^ = (-l)''a det{D) det{g-^). 
where 

D:={F-I) + K-^U - - JVH{z)\i^VH{z) +* X^F - I)]. 

a 

Then, we compute det(Z3) in the basis /3o (^i, . . . ,W2d) where vi := JVH{z), V2 is such that 
V2 -L J\7H{z) and (wi, ^2) is a basis of ker(F — 7)^. Lastly (^3, . . . V2d) is a basis of Vz ■= (B E\. 

Let us set w :— ^{F + I)VH{z). We have Dvi — —w and, using lemma 



(4.24) 



((F - /) + K-^Ii)v2 = {F- I)v2. 



^NB : a ^ since I -W is invertible and JS/H{z) ^ 0. 
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(4.25) -JVH{z)\i*\'H{z)+*Xi{F-I)]v2 = -{i < VH{z),V2 > + < Xi, {F-I)v2 >)JVH{z). 
a a 

Using the fact that {F — I)v2 E Ei, one easily gets that there exists Ai e M such that {F — I)v2 = 
\iJVH{z). Thus < Xi, {F - I)v2 Aia. We obtain, using and K^ : 



(4.26) 



DV2 



< VH{z),V2 > JVH{z). 



Note that {F - 7)14 C V^. Moreover K^^Il is of rank 1. Hence, since its image is equal to 
K^^Ilvi = —w 7^ 0, we can neglect it on others columns than the first column. The same idea 
holds for —JWH{z)[i*WH{z) +* Xi{F — I)], which we neglect in other columns than the second 
one (since"i JVi?(z)[i*ViJ(z) Xi{F - I)]v2 ^ 0). Therefore: 



— Wi 


-^<VH{Z),V2> 





— W2 







-W3 













-W2d 








\ 



det(D) = det 



where (wi, . . . , W2d) are coordinates of w in basis Pq. 
Hence det(i:») = -^W2 < VH{z),V2 > det((i^ - /)|^,J. 
We write 

w = ^{F + I)VH{z) = wiJVH{z) + W2V2 + V 

where v G Vz, then we take the scalar product with VH{z). Since Ei = (JT^)"*", we have 
< v,VH{z) >= 0. and i\VH{z)\'^ = W2 < V2]VH{z) > . Thus we get: 

dei{D) = ^|Vi/(z)|2 det((i^ - I),^^ ). 
Therefore, according to (|4.23() 

(4.27) dg{t, z)-2 = {-lf\VH{z)\'' det((7^ - ) det(g-i). 

Since det(5^^) ~ ±1, there exists k £ 1^, depending on g, such that: 



dn(t,z) 

|Vi?(z)||det((F-/)|,J|i 
Moreover, dg being continuous, k doesn't depend on z G 7. Thus by Theorem 14.41 we have, if 



3z G : A/(.g)$t(z) = z}: 



Moreover, if z G 7, then: 



2^|det((F-/)|,^: 



dj 

Wm 



0{h). 



d-y 

Wm 



\jyH{<Pt{z))\- 



dt 



VH{4>t{z))\ 



Lastly, we sum on g G G to get the expansion of 9xW- This ends the proof of Theorem 14. 71 □ 

5. Appendix : Coherent states 

We recall some basic things on coherent states on R^"* in Schrodinger representation. We 
mainly follow the presentation of M.Combescure and D. Robert (cf [B], |26|). 
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5.1. Notations. The /i-scaling unitary operator Ah : L^{R ) L'^{R°-) is defined by: 



hi \a2 

The phase translation unitary operator associated to a = {q,p) x is given by: 7h{ct) ■- 

exp[j^{px — q.hD^)]. We classically have 7h{ct)* ~ 7ii{a)^^ = T/i(— a) and: 



(5.1) 



Thia)f{x) = exp [^J^{x - |)) -/{x - q). 



The ground state of the harmonic oscillator —A + |xp is given by ^'0(2;) := exp(— ■^) 



We set: 
(5.2) 



il>o{x) := Ahijjoix) 



1 , N% 



Then the coherent state associated to a € M.'^'^ is given by (pa ■— 7h{a)ipo- By ()5.1|l . we have: 
(5.3) 



\x - q\" 



2h 



(hT:) 

and we get easily from l|5.1|l the following formulae: 

Al7h{a)Ah = ^i(;^) and AlOp^,{a)Ah = Op'^iau), where ah{z) := a{Vhz). 

7h{a)7h{l3) = e^<''''P>7h{a + /3) and iH^a)* Op'{i{a)7h{a) = OpfAaia + .)]. 
5.2. A trace formula. 

If A e L{L'^{W^)) is trace class, then Jjj2d | < ^vSq;;^^ >L2(Rd) \da < +00, and we have: 



(5.4) 



Tr(A) = (27r/i) I < Aipa^^a >L2(Rd) da. 



For a proof, see for example IS]. 

5.3. Propagation of coherent states. For z — {q,p) € M'' x M'^, let Zt = {qt,Pt) ■= ^t{z) be 
the solution of the Hamiltonian system H1.2|l with initial condition z. We introduce the notations: 



(5.5) 



S{t,z):^ / {ps.qs ~ H[zs))ds 



(5.6) 5[t,z) -.^ S{t,z) 

where Fa{t) = 9^$t(a) e Sp{d,M.). We set: 



(5.7) 



C D 



where A,B,C,D e A/d(M). 



Theorem 5.1. Semi-classical propagation of coherent states (Combes cure- Robert) [5], |26j ; 
Let T > 0. Let H : M.'^'^ R be a smooth Hamiltonian satisfying, for all a G N^'' ." 

(5.8) \d"H{z)\ <Ca<x >"°, where m„ > 0, > 0. 

Let a £ M.'^'^ be such that the solution with initial condition a of the system Zt — J'S/H{zt) is 
defined for t g] — T,T[. We denote by Uh{t) := e^^T^^ the quantum propagator. 
Then, VAf G N, 3Cm,t{(^) > 0, independant of h and of t G [— T, T] such that: 

M 



Uhit)ipa-e' Th{at)Ah 



Y^hhj{t,a){. 



X .62 



< Mo x^x> 



M+l 

< CM,T{a)- h 2 , 



L2(R<i) 
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where Mq := (C + iD){A + iB)-^ , for all t e] - T,T[, bj{t,a) : R"^ ^ C is a polynomial 
independant of h, with degree lower than Sj, with same parity as j, and smoothly dependant of 

(t,a). In particular, bQ{t, a){x) — t:~t {det{ A + iB))c ^• 

Moreover, if solutions of the Hamiltonian classical system are defined on [—T, T] for initial 
conditions a in a compact K , then a i— > Cm,t{oi) is upper hounded on K by Cm.t.k independant 
ofaeK. 
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